The Evolutionary Vaccination Dilemma in Complex Networks 
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In this work we analyze the evolution of voluntary vaccination in networked populations by entangling the 
spreading dynamics of an influenza-like disease with an evolutionary framework taking place at the end of each 
influenza season so that individuals take or not the vaccine upon their previous experience. Our framework thus 
put in competition two well-known dynamical properties of scale-free networks: the fast propagation of diseases 
and the promotion of cooperative behaviors. Our results show that when vaccine is perfect scale-free networks 
enhance the vaccination behavior with respect to random graphs with homogeneous connectivity patterns. How- 
ever, when imperfection appears we find a cross-over effect so that the number of infected (vaccinated) individ- 
uals increases (decreases) with respect to homogeneous networks, thus showing up the competition between the 
aforementioned properties of scale-free graphs. 
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I. INTRODUCTION 

The advent of network science 01 [H has provided, an im- 
portant set of computational and statistical physics tools for 
describing the problem of epidemic spreading by incorporat- 
ing the realistic interaction patterns of the constituents of so- 
cial and technological systems yfl. Classical approaches to 
epidemiology 0,|5|] rely on the use of the theory of phase tran- 
sitions and critical phenomena, so to unveil the onset and the 
macroscopic impact of epidemic outbreaks. Recently, these 
techniques have been pervasively adapted to study a variety 
of critical phenomena on top of networks ]6|]. 

The main contribution of the former line of research to epi- 
demiology has been the development of a generalized mean- 
field framework in which general patterns of interactions can 
be included. In particular, it was shown lf7h il2ll that for scale- 
free networks [in which the probability distribution of having 
a node with k neighbors follows a power-law, P(k) ~ k~ a ] 
the epidemic onset was anticipated as compared to substrates 
with more regular (or homogeneous) connectivity patterns. 
Moreover, when a < 3 (as most of social and technologi- 
cal networks show lUlH ) and for large enough (thermody- 
namic limit) systems, the epidemic onset vanishes, meaning 
that even a very small fraction of infected elements with small 
infective power can spread a disease to a macroscopic part of 
the population by a sequence of contagions between neighbors 
of the network, as it happens in human contacts lfl5l4l8ll . 

Apart from the theoretical value of the above finding, its 
direct implications on public health campaigns and the secu- 
rity of technological networks such as the Internet demand a 
deeper understanding about the influence that diverse contact 
patterns have on disease dynamics, its co-evolution lfl9i l20ll 
and the design of new algorithms for immunization and vac- 
cination policies. Typically, these studies aim at identifying 
the most efficient way for reducing the impact of an epidemic 
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by the vaccination/immunization of the minimal number of 
nodes. To this aim, different methods to identify the most im- 
portant nodes to be immunized have been proposed ll2ll - l24ll . 

The former works concern the immunization of technolog- 
ical networks since in social contexts vaccination is typically 
voluntary. Thus, the study of the immunization of a popula- 
tion demands to include the ways vaccination and risky be- 
haviors compete and spread across individuals. To this aim, 
one may consider game theory to formulate a social dilemma 
in terms of the benefits associated to each of the behaviors: 
vaccination or not. Within this framework individuals act ra- 
tionally, i.e., by choosing their strategy after an evaluation of 
their potential benefits. This evaluation is done by considering 
their perception of the risk to contract the disease. For well- 
mixed populations recent results show ll25l - l3C)ll that voluntary 
vaccination is not efficient to reach efficient immunization. 
However, this kind of approach was generalized to networks 
I3II1 unveiling an enhancement of voluntary vaccination. 

The former game theoretical approach considers that agents 
aim at maximizing their own benefits. However, the decisions 
of individuals are far from being rational and a more adapted 
formalism is that of evolutionary game theory ll32[l33ll . In this 
framework agents are prone to imitate the strategies of those 
neighbors that performed better in the previous round of the 
game. The evolutionary dynamics of many social dilemmas 
has been studied on top of networks IB4H36I1 showing that co- 
operation (here related to vaccination) is favored in scale-free 
networks HIH- 

In this work, we formulate an evolutionary vaccination 
dilemma following the model presented in l39ll . We explore 
in detail the spread of vaccination behavior across networks 
with homogeneous and heterogeneous (scale-free) connectiv- 
ity patterns. Our results show that when vaccine is perfect 
scale-free networks enhance the vaccination behavior with re- 
spect to homogeneous graphs. However, when vaccine is im- 
perfect we find a cross-over effect, and homogeneous net- 
works outperform scale-free ones. These latter scenario re- 
veals an interesting competition between the rapid spread of 
both diseases and cooperative behaviors in scale-free graphs. 



2 



/ 



; S 


1| Epidemic Spreading 


fv 


<& . 


T[ H ]H I P[ R ] 


i ( NV 









\ 



Update of 
Strategies 



Evaluation of Payoffs 



Vhealthy 
Vreccivered 
NVhtalttiy 
NVnB.m 



7C =-C 
Jt =-c- 
71 = 
7C = -Tl 



Outcome of 
Epidemic Spreading 



FIG. 1: (color online). Resuming sequence of the evolutionary pic- 
ture of our model. The top box descibes the epidemic spreading pro- 
cess. The bottom one, instead, displays the payoffs accumulated by 
the agents according to their strategy. Arrows denote the causal order 
of the evolutionary process. 



H. THE MODEL 

To incoporate the competition between disease spreading 
and evolutionary dynamics on top of a network we entangle 
these two dynamical frameworks by producing an iterative se- 
quence of a two-stage process. In both stages the interaction 
pattern among individuals is described by a complex network 
(keeping the same network for both the dynamical setups). 
This network is given by an (N x N) Adjacency matrix A^ so 
that when two individuals interact Aij = 1, whereas Ay = 



otherwise. In this way, the number fej of neighbors (contacts) 
of a given node, say i, is given by ki = X^j=i ■ 

In this work we will consider two of the most paradigmatic 
network models: Erdos-Renyi (ER) graphs ll40ll and Barabasi- 
Albert (BA) networks ll4lll . The former class of graphs are 
described by a Poisson degree distribution P(k), so that most 
of the nodes have a connectivity close to the mean value (k). 
On the other hand, BA networks display a power-law degree 
distribution of the form, P(k) ~ fc~ 3 , thus incorporating the 
scale-free (SF) property of real-world networks. The imple- 
mentation of our dynamical setup aims at revealing the differ- 
ences between the heterogeneous degree pattern displayed in 
SF and the rather homogeneous structure of ER graphs. Be- 
low we introduce the rules governing the two-stage dynamics 
that it is also sketched in Fig. Q] 



A. Disease spreading 



verse time of the incubation period of the disease. Infected 
nodes, on the other hand, although still carrying the virus are 
here assumed not to be infectious. In particular, we consider 
that during this period they remain isolated from the rest of 
the population. Finally, Infected nodes pass to the Recovered 
state with some probability fx that is the inverse duration time 
of the convalescence period. 

With the above rules we consider that each node interacts 
simultaneously with its fc, neighbors per unit time. Thus, for a 
network described by the Adjacency matrix the effective 
probability that a Susceptible node i gets the disease per unit 
time is given by: 



Pi 



l-(l-A) 



(1) 



where Xj = 1 when node j is Exposed and Xj = otherwise. 
Here, in order to mimic the transmission of ordinary influenza 
we have set /.*' = 0.33, since the time elapsed between ex- 
posure to the virus and development of symptoms is two to 
three days. In addition we take /i = 0.2 since the symptoms 
of influenza last from three to seven days. 

The addition of vaccinated individuals to the formulation 
of our SEIR model implies that initially there is subset of Sus- 
ceptible individuals (representing a fraction Ny of the total 
population) that are less prone to catch the disease than non- 
vaccinated Susceptible ones. In particular, we consider that 
the probability that a vaccinated individual is infected during 
a single contact with an Exposed one is A • 7, where 7 G [0, 1] 
is a parameter that modulates the quality of the vaccine, being 
perfect when 7 = and useless for 7 = 1. In this way, the 
probability that a vaccinated individual i is infected per unit 
time reads: 



= !-(!- 7. A) 



(2) 



Once the values of the epidemic parameters /x and //, the 
quality 7 of the vaccine and the fraction Ny of vaccinated in- 
dividuals are set, we leave A as the relevant control parameter 
of the SEIR model. In addition, the relevant order parameter 
of the dynamics is the the fraction R of nodes that got infected 
once the epidemic process dies out, so that the macroscopic 
behavior is captured by the curve R(X). For a given value 
of A one starts from an initial state in which a small fraction 
(here the 5%) of the population is set as Exposed. Then the 
SEIR dynamics is iterated until no individuals remain either 
as Exposed or Infected. 



The first of the stages of our dynamical setup is based on 
the evolution of a Susceptible-Exposed-Infected-Recovered 
(SEIR) model flUt]. This model captures the dynamics of 
influenza-type infections. Susceptible nodes have not been in- 
fected and are healthy. They catch the disease via direct con- 
tact with Exposed neighbors at a rate A. Exposed nodes are 
supposed to carry the virus although they still do not display 
symptoms of the disease, thus these individuals are highly in- 
fectious during this incubation period. Exposed nodes become 
Infected with some probability // which typically is the in- 



B. Evolutionary Dynamics 

Once the SEIR dynamics dies out we consider that the sea- 
sonal influenza period has passed. Before the next SEIR dy- 
namics starts, individuals evaluate whether to vaccinate or 
not for the next season. At this point evolutionary dynamics 
takes place by assigning to each of the individuals a payoff 7T; 
(i = 1, N) that depends on their experience accumulated 
during the last SEIR propagation. As shown in Fig. Q] there 
are four possibilities: 
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(i) Vaccinated individuals that remain healthy during the 
last season have payoff tt = — c (where c is a cost asso- 
ciated to the vaccine). 

( ii) Vaccinated individuals that were infected during the last 
season have payoff tt = — c — Tj (where Tj is the time 
units that the individual remain in the Infected state). 

( Hi) Individuals that did not vaccinated and remain healthy 
during the season have payoff tt = 0. 

(iv) Non-vaccinated individuals that were infected are as- 
signed a payoff tt = —Tj. 

The cost c associated to the vaccination is related to differ- 
ent issues such as the time needed to get vaccinated (via Public 
Health Services) or the probability that the vaccine causes side 
effects. To illustrate the vaccination dilemma let us show a 
very simple situation of a susceptible agent i in contact with an 
exposed agent. In this situation the expected payoff of i when 
having taken the vaccine is: TTy P = — (1 — -f\)c— j\(c+l/[i) 
(here we assume that Tj ~ On the other hand, if 

agent i has adopted a risky behavior, its expected payoff turns 
into: TT^y = — A//i. Thus, in this single pairwise encounter, 
the rational choice is not to take the vaccine for any costs 
c > A(l — 7)///. This simple situation clearly reveals the 
Vaccination Dilemma. However, in a networked population 
the situation is rather more complex and, more importantly, 
here we assume that individuals are not fully rational and, in- 
stead of deciding their behavior on expectations, they evolve 
their strategies based on their previous experience. 

Evolutionary dynamics provides the framework to imple- 
ment the dynamical evolution of strategies. In particular, as it 
is usually done in evolutionary social dilemmas on networks, 
each individual, say i, chooses at random one of its first neigh- 
bors, say j, and compares their payoffs TTi and ttj respec- 
tively. Then, the probability that agent i takes the strategy 
of j, Sj, for the next season increases with their payoff differ- 
ence, (iTj — TTi). One of the most used frameworks to calculate 
this probability is that of the Fermi-like rule ll42ll43l . in which 
the probability that the strategy of the neighbor j is adopted 
by i reads: 



1 



1 + CXp [-/3(7Tj - TTi)] 



(3) 



where /3 is a parameter that allows to span between random 
(f3 <C 1) and strong selection (f3 ^ 1). Here we adopted /3 = 
1 and checked that our results are quite robust under changes 
of /3. The update of strategies takes place simultaneously for 
all the agents. Once the new strategies are taken, the payoffs 
are set to zero and the SEIR dynamics starts again with a new 
fraction Ny of vaccinated susceptible individuals. 

Finally, let us note that we iterate the sequence of the two- 
stage process (SEIR dynamics and Evolutionary Dynamics) 
for a number of steps (generations) large enough to reach a 
steady state for the relevant observables: the average fraction 
of recovered, (R), and vaccinated individuals, (Ny). In ad- 
dition, we set 25% of the initial population as vaccinated (we 
have checked that the results presented below are robust under 
changes of the initial conditions). 
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FIG. 2: (color online). The top panel shows the epidemic diagram 
(R)(\) for ER and SF networks when vaccination is not allowed. 
The bottom panel shows the evolution of the fraction of Recovered 
individuals, R, with the generations of the evolutionary dynamics. 
The network is SF and the probability of infection per contact is A = 
0.35, whereas vaccination is perfect 7 = and it has a cost c = 0.1. 



III. RESULTS 

We start our discussion by briefly reporting the behavior of 
the SEIR model without vaccinated individuals. In the top 
panel of Fig. |2]we show the average fraction (R) of recovered 
individuals at the end of the SEIR dynamics as a function of 
the probability of infection per contact, A, for ER and SF net- 
works of N = 1000. From this figure it becomes clear that 
SF networks accelerates the onset A c of the epidemic regime 
as compared to ER graphs. 

Let us now focus on the case of SF networks to evaluate 
the impact that voluntary vaccination (under an evolutionary 
framework) has on the immunization of the system. In the bot- 
tom panel of Fig. [2] we show the evolution of the fraction of 
recovered individuals R for a sequence of 2000 generations. 
The probability of infection used in this simulation is set to 
A = 0.35 which, as the top panel shows, corresponds to a 
situation in which almost all the population has been infected 
(R) ~ 1 when no vaccination is allowed. Instead, when in- 
dividuals can decide whether to take the vaccination (under 
the aforementioned evolutionary rules) we show that the epi- 
demic phase does not appear (R ~ 0) since the population has 
evolutionarily adopted the vaccination strategy. 

Remarkably, the transient regime (lasting around 500 gen- 
erations) shows an interesting pattern of rise-and-falls for the 
number of recovered individuals R. This behavior points out 
that, before vaccination prevails, the population displays an 
oscillating behavior between vaccination and risky behavior. 
Obviously, when many people vaccinate (falls in R) the epi- 
demic falls but vaccinated individuals are tempted not to take 
the vaccine due to the higher benefits of risky individuals. 
This leads to a progressive increase of the infections (denoted 
by the increase of R) that reverse the balance of benefits be- 
tween risky and vaccinated individuals. This rise-and-fall be- 
havior together with the significative duration of this transient 
regime reveal the importance of risk perception in voluntary 
vaccination. 
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FIG. 3: (color online). The contour plots show the average fraction of Recovered (R) (top) and Vaccinated (Nv) (bottom) individuals as 
a function of the infection probability A and the vaccine quality 7 for SF networks. From left to right the panels correspond to different 
vaccination costs: c = 0.1 [panels (a) and (d)], c = 0.5 [panels (b) and (e)] and c = 1.0 [panels (c) and (f)]. As the cost increases we note that 
the overall fraction of vaccinated individuals decreases while that of Recovered nodes increases. Interestingly when c = 0.1 there is a range 
of low 7 values (7 < 0.1) for which the epidemic threshold disappears and the disease cannot spread for any value of A. 



A. Macroscopic behavior of vaccine taking in SF networks 

Now we analyze the behavior after the transient regime. To 
this aim we compute the average fraction of vaccinated (Ny) 
and Recovered (R) individual in the steady state as a function 
of A and the quality 7 of the vaccine. In Fig. [3] we report 
these functions for several vaccine costs c in SF networks. In 
particular, the panels in the top show the diagrams (R)(\, 7) 
and those in the bottom show (Ny)(X, 7)- From left to right 
the panels correspond to the following vaccine costs: c = 0.1, 
0.5 and 1.0. 

Let us focus on those diagrams corresponding to c = 0.1 
[panels (a) and (d)]. The function R(X, 7) shows that for val- 
ues of 7 £ [0, 0.1] (roughly perfect vaccination) the epidemic 
threshold disappears since (R) ~ for all the values of A. In 
its turn, we note from panel (d) that for this latter region the 
fraction of vaccinated individuals is roughly (Nv) — 1 except 
for very low values of A for which the disease cannot spread 
even when no immunization is present. If we increase further 
the value of 7 we recover the epidemic onset A c whose values 
decreases as the vaccine get worse, i.e., as 7 increases. In ad- 
dition, the vaccination behavior decreases so that for a given 
value of 7 the advantage provided by vaccines is not useful 
anymore for A > A c . Obviously, for 7 = 1 we recover the 
usual diagram R(X), shown in the top panel of Fig. Q] for 
SF networks since the vaccine provides no advantage and, as 
shown in panel (d), almost no individual in the network holds 
the vaccination strategy giving (Ny) ~ for all A values. 



As we increase the cost of the vaccine to c = 0.5 [panels 
(b) and (e)] and c = 1.0 [panels (c) and (f)] we observe that 
the overall fraction of Recovered (Vaccinated) individuals in- 
creases (decreases). Remarkably, the maximum value of 7 for 
which there is no epidemic threshold decreases with c and for 
c = 1.0 we cannot appreciate this effect. It is interesting to 
note that the usual epidemic diagram of SF networks without 
immunization is recovered for lower values of 7. For instance, 
in panel (b) we note that for 7 > 0.6 the curve R(X) does not 
change whereas from panel (e) we note that, within this re- 
gion, individuals do not vaccinate anymore ((Ny) = 0). 



B. SF versus ER networks: The importance of vaccine quality 

Having reported the macroscopic behavior in SF networks 
as concerns the influence of the vaccine quality and its cost, 
we now focus on the dependence on the networked sub- 
strate in which both the disease and the vaccination strategies 
spread. To this aim, we consider ER networks to measure the 
role of degree heterogeneity on the vaccination behavior. 

We first explore the case of perfect vaccination, 7 = 0. In 
Fig.lHwe show the diagrams (R)(X) (top) and (Ny)(X) (bot- 
tom) for two different vaccination costs: c = 0.5 [panels (a) 
and (c)] and c = 1.0 [panels (b) and (d)]. From the panels 
we observe that SF networks outperform ER graphs since the 
overall average number of recovered (vaccinated) individuals 
is smaller (higher) in SF networks. In particular, the epidemic 



5 





(a) 


SF — ■ — 


1 1 

; • 


ER — •— 















. t 


(b) 


i 

I 






SF ■ 


ER • 


ii ■ v 

} 










FIG. 4: (color online). Epidemic (J?) (A) (top panels) and Vacci- 
nation (Nv)(X) (bottom panels) diagrams for ER and SF networks 
when the vaccine is perfect (7 = 0). The cost associated to the vac- 
cine are c = 0.5 (left panels) and c = 1.0 (right panels). 



diagrams (R)(X) display a clear peak around the respective 
epidemic thresholds, A c , of the original (without vaccination) 
graphs. Up to this point A < A c , the epidemic does not spread 
and thus vaccination behavior is not observed either as shown 
in the diagrams (Ny } (A). The peak thus point out that the risk 
is so small that vaccination behavior do not show up and lead- 
ing to a burst of infections which reaches higher values in ER 
graphs. This result seems counterintuitive, since from the lit- 
erature on epidemic on epidemics on networks, SF graphs are 
always more prone to the spread of diseases than ER ones. 
Furthermore, from the diagrams (Ny)(X) we note that the 
vaccination onset starts earlier for SF graphs, as their natural 
epidemic threshold are smaller than that of ER ones. 

For values of A above the natural epidemic threshold, the 
number of Recovered nodes decreases dramatically in both 
networks. Here, the risk of infection becomes larger and in- 
dividuals start to adopt the vaccination strategy as diagrams 
(Ny)(X) in panels (c) and (d) show. However, vaccination be- 
havior spreads easier in SF networks than in ER graphs and it 
is quite remarkable that, for this regime, the number of Recov- 
ered nodes in ER graphs is always (for any value of A) higher 
than in SF networks. Thus cooperative behavior, by taking 
the vaccine, spreads better in SF networks, in agreement with 
those studies about cooperation and social dilemmas in com- 
plex networks sin. 

In Fig. [3] we explore the scenario of imperfect vaccination 
considering 7 = 0.12. This regime shows the competition be- 
tween two well-known effects: the aforementioned prevalence 
of cooperative behaviors in SF networks (with respect to ER 
graphs) and their weakness to the spread of diseases (again 
with respect to ER graphs). This competition appears as a 
crossover between the behavior of both (R)(X) and (Ny}(\) 
in SF and ER networks. In panels (a) and (b) we show that 




FIG. 5: (color online). Epidemic (R)(\) (top panels) and Vaccination 
(iVy)(A) (bottom panels) diagrams for ER and SF networks when 
the vaccine is not perfect (7 = 0.12). The cost associated to the 
vaccine are c = 0.5 (left panels) and c = 1.0 (right panels). The 
imperfection of the vaccine causes two crossovers, one for (R) and 
the other one for (Nv), between the performance of SF networks 
and ER graphs. 



the curves (i£)(A) (after the peak close to the natural epi- 
demic thresholds of both networks) cross at some A* values, 
which decreases with the cost of the vaccine c. Panels (c) and 
(d) show also a crossover behavior for (Ny)(X), which ap- 
pears with some delay with respect to that occurring at A* for 
(R)(X). 

The behavior for A < A* shows the same trend as for 
the perfect vaccination case. SF networks outperform ER 
graphs showing a larger number of vaccinated individuals and 
a smaller number of infections. However, for the imperfect 
vaccine (7 > 0) the growth of A affects both non-vaccinated 
and vaccinated individuals. Under such conditions, the virus 
finds in the SF networks a better backbone to propagate. In 
this way, panels (a) and (b) show that the failure of vaccination 
starts to become evident in SF networks at A*. The smaller 
benefits provided by the imperfection of the vaccine cause that 
the number of vaccinated individuals starts to decrease after 
A*. Being larger the number of infections due to the imper- 
fect vaccine in SF networks, as shown for A > A*, the fall of 
vaccinated individuals occurs in SF networks at smaller val- 
ues of A than in ER graphs, giving rise to the crossover for 
{Ny) shown in panels (c) and (d). 

It is quite remarkable that for large A values and for c = 
1.0 [panels (b) and (d)] the number of vaccinated individuals 
vanishes and the values of (R) goes close to one in a similar 
way as in the original network (without vaccination). As cost 
increases, the solution (R) ~ 1 spans across a larger interval 
of A values and one finally recovers the diagram of Fig. 0(a). 
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IV. CONCLUSIONS 

In this work we have analyzed the evolution of voluntary 
vaccination in networked populations. At variance with clas- 
sical approaches we have considered an evolutionary frame- 
work so that individuals facing the vaccination dilemma do 
not take the most rational strategy by considering the benefits 
associated to each choice. On the contrary, they are consid- 
ered as replicating agents that imitate the strategies based on 
their previous experience. To this aim we have entangled the 
spreading dynamics of an influenza-like disease with an evo- 
lutionary framework taking place at the end of each season. 
Our results show that when vaccine is perfect (so that vacci- 
nated individuals do not get infected) scale-free networks en- 
hance both the vaccination behavior and the effective immu- 
nization of the population as compared with random graphs 
with homogeneous connectivity patterns. 

By considering vaccine imperfection we obtain two re- 
markable results. First, we have shown that, for scale-free net- 
works and low vaccine costs, there is a threshold value for the 
vaccine imperfection so that, for values lower than this thresh- 
old, vaccination behavior spans across the population and it is 
possible to suppress the disease for all the infection proba- 
bilities. Instead, when vaccine imperfection becomes large, 
agents are less prone to take it and the disease takes advan- 
tage of this risky behavior to spread more efficiently across 
the population. 



The other interesting result concerns the comparison be- 
tween scale-free and homogeneous networks. We have shown 
that when imperfection appears the better performance of 
scale-free network is broken and there is a cross-over effect 
so that the number of infected (vaccinated) individuals in- 
creases (decreases) with respect to homogeneous networks 
when the probability of infection is large enough. This cross- 
over results from the competition of two well-known dynam- 
ical properties of scale-free networks: the fast propagation of 
diseases and the promotion of cooperative behaviors. Thus, 
the ability of scale-free networks in promoting cooperative be- 
haviors (here represented as paying the cost of taking vaccine) 
is threatened when payoffs are dependent on a related dynam- 
ical process (here the spreading of a disease) whose evolution 
is also affected (here enhanced) by the heterogeneity of the 
network. 
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